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Abstract 

In Econometrics, imposing restrictions without assuming underlying distributions to modelize complex 
realities is a valuable methodological tool. However, if a subset of restrictions were not correctly specified, 
the usual test-statistics for correctly specified models tend to reject erronously a simple null hypothesis. In 
this setting, we may say that the model suffers from misspecification. We study the behavior of empirical phi- 
divergence test-statistics, introduced in Balakrishnan et al. (2015), by using the exponential tilted empirical 
likelihood estimators of Schennach (2007), as a good compromise between the efficiency of the significance 
level for small sample sizes and the robustness under misspecification. 
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1 Introduction 

Let Xi, ...,X„ be i.i.d. observations on a data vector X with unknown distribution function F having a hnite 
expectation, a non-singular variance-covariance matrix and a p-dimensional parameter of interest, 6 G Q G 
All the information about F and 9 is available in the form of r > p estimating functions of the data observation 
X and the parameter 9 

g{X,9) = {g,{X,9),...,gr{X,9)f. (1) 

*This paper was supported by the Spanish Grants MTM-2012-33740 and ECO-2011-25706. 
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The model has a true parameter 6q satisfying the moment condition 

EF[g{X,eo)]=Or, ( 2 ) 

where E p [•] denotes expectation taken with respect to the distribution of F of X. The parameter 6 has been 
traditionally estimated using two-step efficient generalized method of moments estimators (GMM). This method 
of estimation was introduced by Hansen (1982). In Hayashi (2000), for instance, all the estimation techniques 
are presented and discussed in the GMM framework. A GMM estimator for Oq is Ogmm, defined by 


where 


Ogmm = argming^(X, 0)ty;i(0)g„(X, 0), 

0G© 


g^{X,e) = -Y^g{X,,e) 


and Wn is a positive semidefinite matrix. Under some regularity conditions Ogmm is consistent for 6q but in 
general it is not efficient if r > p. The Ogmm will be asymptotically efficient if the limit of the matrix Wn is 


the matrix 


Sn{Oo) = EF [g{X,Oo)g^{X,Oo) . 


A feasible version of this efficient procedure is based on obtaining an initial consistent estimator 0 of Oq by. 


and then to consider 


0 = argmmgl{X,0)g„{X,0) 


Ogmm = argmmgl{X,0)S-^-l{0)g„{X,0), 


Sn{0) = - Vg(X„ 0)g^{X,, 0). (5) 

An alternative to the GMM estimator is the (CU) continuous updating estimator obtained by 

Ocu = argming^(X,6»)Sy (6»)g„(X,0). 

The GMM estimators have nice asymptotic properties (see Gallant and White (1988), Newey and McFadden 
(1990)). They are consistent, asymptotically normal and asymptotically efficient under some regularity assump¬ 
tions. However, several authors report that the two-step GMM estimator suffers from a substantial amount 
of bias in finite samples (see Altonji and Segal (1996), Andersen and Sprensen (1996) and Hansen, Heaton 
and Yaron (1996)). This encourages the increasing literature on alternatives to the GMM. Maybe the most 
known alternative estimators to the GMM are: the continuously updated (CU) estimator of Hansen, Heaton 
and Yaron (1996), the empirical likelihood estimator (EL) of Owen (1988, 1990), Qin and Lawless (1994), and 
Imbens (1997), the exponential tilting (ET) estimator of Kitamura and Stutzer (1997) and Imbens, Spady and 
Johnson (1998), the minimum Hellinger distance estimator of Kitamura, Otsa and Evdokimov (2013) and the 
generalized empirical likelihood (GEL) estimators of Newey and Smith (2004). Although EL estimator is prefer¬ 
able to the previous estimators in higher-order asymptotic properties, these properties hold only under correct 
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specification of the moment condition, and the asymptotic behavior of EL estimator becomes problematic un¬ 
der misspecification. The ET estimator is inferior to the EL estimator in relation to higher-order asymptotic 
properties, but remain well behaved in presence of misspecification under relative weak regularity conditions. 
To overcome this problem, Schennach (2007) suggests the exponentially tilted empirical likelihood (ETEL) that 
shares the same higher-order property with EL under correct specification while maintaining usual asymptotic 
properties such as -y/n-consistency and asymptotic normality under misspecification. 

Qin and Lawless (1994) studied the empirical likelihood ratio statistic for testing simple null hypotheses based 
on the EL estimators. Later Balakrishnan et al. (2015), using EL, considered some families of test statistics 
based on ^-divergence measures: empirical ())-divergence test statistics, which contain the empirical likelihood 
ratio test as a particular case. Some members of this family have a better behavior for small sample sizes in 
the sense of the size and power of the test. The contribution of the current paper is to extend the empirical cj)- 
divergence test statistics replacing the EL estimators by the ET and ETEL estimators to study their robustness, 
in particular under misspecification, which is their major advantage with respect to the previous ones. 

In Section[2]we introduce the ETEL estimator given by Schennach (2007) which is obtained as a combination 
of EL and ET procedures to deliver an estimator and we present its asymptotic properties. Section |3] is devoted 
to introduce the empirical (/)-divergence statistics for testing simple null hypotheses on the basis of the ETEL 
estimator and we present their asymptotic distribution. Based on it, power approximations of the empirical 
())-divergence test statistics are derived. A rigorous study of the robustness of the empirical (/(-divergence test 
statistics is derived in Section S] and the asymptotic distribution of the empirical (/(-divergence is developed 
under misspecified alternative hypotheses. In Section 0 a simulation study is presented and finally, in Section 
15] some conclusions are given. 

2 Exponentially tilted empirical likelihood 

Let a;i,..., be a realization of Xi,..., Xn- The empirical likelihood function is given by 

n n 

= Y[dF{Xi) = Wpi, 

i=l i=l 

where pi = dF (xi) = P{X = Xi). Only distributions with an atom of probability at each Xi have non-zero 
likelihood, and without consideration of estimating functions, the empirical likelihood function is seen to 
be maximized, at Xi = a;i, ...,X„ = Xn, by the empirical distribution function 

n 

Fn (x) = '^uJiXi < X), 

which is associated with the n-dimensional discrete uniform distribution 

n 

U= (ui,...,Unf = 

Let 

n 

{x)=J2p^ {0)I{Xi < x), 

2=1 
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be an empirical distribution function associated with the probability vector 


P{S) = p^{0)>O, ^pi(0) = l, (6) 


and 

n 

(ELiO) = '^^0gpi{e) (7) 

i=l 

the kernel of the empirical log-likelihood function. The moment conditions given in ([5]) can be expressed from 
an empirical point of view as 

n 

EE^,A9{x,e)] = Y,p^is)9{x^,e) = 0r, ( 8 ) 

i=l 

which are the so-called estimating equations. If we are interested in maximizing ([7]) subject to ([5]), by applying 
the Lagrange multipliers method it is possible to reduce the dimension of the probability vector (n), to the 
number of estimating functions (r), since 


PEL.i {0) = 


i = 1, ...,n, 


nl + tlA(^)g{X,,0) 

where tEL{0) is an r-dimensional vector to be determined by solving the non-linear system of r equations, 


(9) 


1 

n 


E 


1 

1 + ^'ELi^)9{Xi, 0) 


9{Xi,0) = Or, 


s.t. t'^^{0)g{Xi,0) > -—- 


( 10 ) 


Maximizing expression © is equivalent to minimize the expression 

1 " 

-E^°S (np, {0)) 

and this expression can be written as the Kullback-Leibler divergence measure between the probability vectors 
u and p {6), i.e., 

n 

DkmW {u,p{0)) = 

Therefore, 

0el = argmini^Kuii iu,PEL (®)) 

subject to the restrictions given in ([5]). 

If we consider DkuU {p {0) , u)^ rather than DKun{u,p{0)), we get the empirical exponential tilting (ET) 
estimator, considered for instance in Kitamura and Stutzer (1997). In that case 


0et = arg min DkuII {p (0), u). 

where 

n 

DkuW {p (0 ), u) = '^p, (0) log {np, (0)) (11) 

2=1 
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and 


exp{t]^j,{e)g{Xi,e)} 

PET,i (6) = — -, * = 1, n, 

^exp{t|-r(0)gr(Xj,0)} 
i=i 

where tExid) is an r-dimensional vector to be determined by solving the non-linear system of r equations 

1 


(12) 


-^exp{t|-r(e)g(Xi,e)}g(Xi,e) = 0^. 


(13) 


The exponentially tilted empirical likelihood (ETEL) introduced by Schennach (2007) combines EL and ET 
procedures to deliver an estimator. The ETEL estimator is defined as 


where 


Oetel = argminZlKuii {u,Pet (^))) 


Pet (®) = {PET,1 (0) , .■■,PET,n (^))^, 


(14) 


(15) 


and pET,i (0) is given by (HD). Theorem 1 in Schennach establishes that the ETEL estimator of 9 maximizes 
the kernel of the empirical log-likelihood function given by 

n / n \ 

^ETEhiO) ^^\ogpET,i {9) = - log -^exp{t|)-r(0) [g{X„9) -g^{X ,9)]} , (16) 

i=i \”'i=i / 

where tET{9) is obtained by solving (IT^ and g^{X,9) was defined in ([D- In Schennach (2007, page 659) the 
following important relation for this paper is presented, 


9n{X,9o) 


Sll {9o) Si2 {9o) \ / tET{9 etel) 


0 


•p J \ ^12 (®o) Opxp / \ 9etel 9q 


= Op(n ^/^), 


with Sll (9o) given in (ID, and 


Si2(9)=Ee [Gx{9)\ 

_d 

89 


Gx{9) = ^g{X,9). 


Based on (HD, we have 


9etel -9o = V (0o) (0o) (^o) 9„(X, 9o) + 


(17) 


(18) 

(19) 


where 


and 


where 


V 


i9o)= [s^A9o)S^,^{9o)Si2{9o)) \ 


tET{9ETEL) = —R {9o) , 0o) + Op{n ^/^). 


R (0o) = (^o) - (^o) S 12 (0o) V (0o) SI 2 (^o) (^ 0 ) • 


( 20 ) 

( 21 ) 
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Expression m is obtained from (HZl. Hence, 

Vni0ETEL — do) A/’(Op, y (0o)) 5 

n—^co 

and 

\/ntET{0ETEL) A/” (Or,-R (0o)) • 

n—¥oo 

In the following section we propose a new family of empirical test statistics for testing a simple null hypothesis, 
when the unknown parameters are estimated using the ETEL estimator defined in (11411 and then derive their 
asymptotic distribution. 


3 New family of empirical phi-divergence test statistics 

The empirical likelihood ratio statistic for testing 

Hq: 0 = 00 vs. Hi: 9 ^ 9^ 
based on the ETEL estimator has the expression 

n n 

Gn{9ETEL,9o) = Pet, i{9ETEL) — 2^ logp_ET,i(0o) 

i—1 2—1 

= —2n (^iETEL{9o) — (-etel{9etel)^ , 

where isTELi*) was defined in (ITHll . Schennach (2007) established that under Hq 


( 22 ) 


(23) 


Gn{9ETEL,9o) A- 

71—^00 


P’ 


It is clear that the empirical likelihood ratio test statistic given in (I23p can be expressed as 
G\{9etel, 0o) = 2n ^RkuII (w,P_et (^o)) — RkuII {u,Pet{9etel)^^ , 
where p^rp (0) is (fT51) . 

We shall denote by the class of all convex functions (p : K.'*' —R such that at x = 1, (/>(1) = 0, 
(j)'' (1) > 0, and at cc = 0, 00(0/0) = 0 and 00 (p/0) = plimu^oo If instead of considering the Kullback- 
Leibler divergence measure, we consider a general function 0 G <I>* to define the 0-divergence measure between 
the probability vectors u and p (0) as 


{u,p{9)) = '^p, {9)(p 


2=1 


Ui 


P^ iO)J’ 


G $*, 


we obtain a new family of empirical test statistics for testing (1^^ given by 

2n 


T^i9ETEL,9o) = (m,P_ET (^o))--D0 (u,PETi^ETEL 


(24) 


(25) 


i.e.. 


Ti{9ETEM = ^ -E^P^T.(0i^Ti.L)0 


1 


npET,i{9ETEL) ^ 
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Moreover, the enipirical likelihood ratio test statistic falls inside this new family since G^{6ETEL,n,do) = 
T^(Oetel,Oo), with </> (a:) = a; log a; - x + 1. 

It is well-known that the family of test statistics based on (/)-divergence measures has some nice and optimal 
properties for different inferential problems in relation to efficiency, but especially in relation to robustness; see 
Pardo (2006) and Basu et al. (2011). 

For every 0 G $* differentiable at x = 1, the function ip (x) = (j){x) — (x — 1) (j)' (1) also belongs to $*. Then, 
we have 

T^{(^etel,0q) = {Betel, do) 


and (fi has the additional property that yj' (1) = 0. Since the two divergence measures are equivalent, without 
any loss of generality we can consider the set $ = $* fl {0 : ((i' (1) = 0}. In what follows, we shall assume that 


Another family of statistics for testing the hypotheses in 
between Pet{^etel) and Pet {Bo), namely, 


Sf,{BETEL, Bo) = 


2n 


r{l) 

2n 


{pet{^etel),Pet (®o)) , is given by 
{pet{^etel),Pet (®o) 


based only on the ^-divergence measure 


(26) 


y^,PET,i {Bq) (j) 


C PET,i{BETEL) 
PET,i {Bo) 


where ^ is a function satisfying the same conditions as function (p used to construct T^{Betel,Bo). 

We shall refer to both families of test statistics as empirical ^-divergence test statistics. The first family 
has been applied for the first time in Broniatowski and Keziou (2012) but using the EL estimator rather than 
the ETEL estimator and only in the case that the parameter dimension is equal to the number of estimating 
equations {p = r). Both families were applied in Balakrishnan et al. (2015) only with the EL estimator. 


Condition 1 Let H-H denote any vector or matrix norm. We shall assume the following regularity conditions 
(Theorem 1 in Qin and Lawless, 1994): 

i) S'!! {Bq) in ^ is positive definite, and for S 12 {Bq) in U8\) . rank(5'i2 (^o)) = Pi 

ii) There exists a neighborhood of Bq in which ||g(A',0)||^ is bounded by some integrable function of X; 

Hi) There exists a neighborhood of Bq in which Gx{B), given in m, is continuous and l|Gx(e)|| is bounded 
by some integrable function of X; 

iv) There exists a neighborhood of Bq in which is continuous and 

function of X. 

The asymptotic distribution of the empirical (()-divergence test statistics, T^{Betel,Bo) and S!^{Betel, Bq), 
is given in the following theorem. 


dGxje) 

oe 


is bounded by some integrable 


Theorem 2 Under Condition]^ and under the null hypothesis given in 

T^{Betel, Bq), S)){Betel,Bo) Xp- 

rj .—^ 
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Proof. We shall prove the result for S'^{0 eteLtSo). In a similar way can be established the result for 
T^{Oetel,Sq). 

Let us consider 

t-ETEL = tETi^ETEL) and to = t{Oo). 

We rename (pet(^etel),Pet (^o)) = d^(tETEL,to) as a function oftETEL and to, i.e. 


d(j>(tETEL,to) = ^ ■ 


exp{iifg(a;i,0o)} 


eyip{tETEL9{xi,B etel)} / eyip{tlg(xi,eo)} 


ti E”=iexp{to9(a=,,0o)} exp{WL9(a=.,^iJTiJL)} / exp{to ^o)} 

A second-order Taylor expansion of d,j,(iETEL,to) around (Oj.,Or) gives 

dd^ {ti,t2) 


drj,{tETEL,to) = d^ (0^, 0^) H- ^ 


dti 

1-T d'^d^ {ti,t2) 

.^tETEL 

yT d^d,p{ti,t2) 


tETEL+ 


dti 


tl=t2=0r 


ti=t2=0 


■2 , 1 2 .T 9'^d^{ti,t2) 

5'» 3t,ae 


tx=t2=0r 


dt2dt{ 


to + o{\\tETEL\\^) + o (||to|P) ■ 


ti=t2=0r 


It is easy to show that 

del, (Or, Or) = 0 

d^dej, {tl,t2) 


ddej, iti,t2) 


dti 


ddej, {ti,t2) 


tl —12 — Or 


dti 


= Oi 


tl—12—Or 


dtidt{ 

d^d^ {ti,t2) 


d'^def, {ti,t2) 


dt2dt{ 


tl=t2=0r 


ti=t2=0r 


dt2dti 


= <j>" (1) §11 {Bo) = r (1) S'!! (Bo) + Op(lrx.), 


tl—12—Or 


= -0" (1) Sii (Bo) = (1) Sn (Bo) + Op(lrxr). 


Then, we have 


St{B 


ETEL ,»0 


6»n) = 


2nd,p(t 


ETEL, VO) 


r (1) 


— nt^rp^j^Sii (Bq) tETEL + nto Sii (Bo) to — 2nt^rp^^Sii {Bo) to + o{n\\tETEL\\'^) + o (n||to||^) • 


Denoting 

1 " 

h{t{B)) = -'^eyrp{t^ {B)g{Xi,B)}g{X„B), 

i=l 

from hi A) the Taylor expansion of h{to) around to = Or is equal to 

Or = h{Or) + ^ g^rp h{to)\^^_Q^ to O (||to||lr) , 

where h{Qr) =g„(X,0o); ^ ^(*o)lt(,=Or — *^11 (^o) — *^11 (^o) ~l~ ^p(lrxr‘); Cll^d fvOTfl it th,G folloWlTig TcldtlOTl 
is obtained 


= -5'ii^ (Bo) Bo) + Op(lr), 


(27) 


























Taking into account (dip and it holds 

nt^TELSii {do)tETEL = ngJ(X, Sq)-?? (^o) 9„(^, ^o) + Op(l), 

nips'll (0o)<o = ngl{X,eo)S^l {eo)g^{X,eo) + Op(l), 

ni^TELSii ido)to = ngl{X,eo)R{eo)gr,{X,60) + Op{l), 

and consequently 

0 \ 2nd^(tETEL,to) 
ol\PETEL,ffo) = -- 

= ngl{X, 0o)Sri' (0o) ^12 (^o) V (^o) ^^2 (^o) (^o) ^o) + Op(l) 

= nC(X,0o)5n {Oo)Si2 (@ 0 ) V (@ 0 ) V (©o) V (@ 0 ) Sf^ (©o) S’/ (0o)g„(X,eo) + Op(l) 

= y/n{6ETEL — Sof- V ^ (Oq) ^Jn{9ETEL — 9o) + Op(l) 

= (^\/nV {9o) {Betel — 9o)'^ \/nV {Bq) {Betel —Bq) + Op{l). 

It is clear that 

{Bo) (Betel-B o) A Ar{0,lp), 

n—^oc 

where Ip is thepxp identity matrix. Now, applying Lemma 3 of Ferguson (1996), we readily obtain the desired 
asymptotic distribution. ■ 

Based on the asymptotic null distribution presented in Theorem[21 we reject the null hypothesis in (Ea), with 
significance level a, in favour of the alternative hypothesis, if Sf){BETEL,Bo) > Xp,a (o'* if T(({Setel,Bo) > 
Xp a))^ where Xp a i® fii® (1 ~ aj-th quantile of the chi-squared distribution with p degrees of freedom. In most 
cases, the power function of this test procedure cannot be derived explicitly. In the following theorem, we 
present an asymptotic result, which provides an approximation of the power of the empirical ^-divergence test 
statistics described previously. 


Theorem 3 Under the assumption that B* ^ Bo is the true parameter value 

(4‘"{^)Ti{(^ETEL,Bo) 


{Bo, B*)M^, {Bo, B*)s^, {Bo,B* 


where 


.,{Bo,B*) =F-pl [exp{T^g(X,eo)}] ^e. 


2n 


exp{T'^g{X,Bo)}ip 


-p4Bo,B*) ^ at(0,1), 


Efg. [exp{T^g(X,eo)}] 

exp{T^g(X,eo)} 


g{X,Bo) 


(28) 


T is the solution of 


Ef^. [exp{'r^g(X, Bo)}g{X, Sq)] = 0 ^, 


'lp{x) = (p{x) — x4>'{x), 


(29) 


M^,{Bo,B*) = F-pl [exp{T^g{X,Bo)}g{X,Bo)g^{X,Bo)\ 9{X,Bo)}g{X,Bo)g^{X,Bo)]) 


X [exp{T^g{X,Bo)}g{X,Bo)g^{X,Bo)] , 


(30) 
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and 


[exp{x^g(X,0o)}] 


exp{T'^g{X,eo)}(j) 


'e [exp{T^g(X,0o)}] 


exp{r^g(X,0o)} 

Proof. We rename {u,p^j, (0)) = d^{u,t{6)) as a function of u and t{6), i.e. 


(31) 


^exp{t'^(0)g(Xj,6>)} 

d^{u,t{e)) = \^exp{t^{e)g{Xj,e)}\ ^exp{t^{e)g{Xi,e)}(l) 




nexp{t^ {e)g{Xi,e)} 


\ 




and in particular for 0 — 8q and 6— Betel, D^{u,p^^{9q)) = d^{u,to) and D^{u,p^j,{6etel)) = 


d^{u,tETEL)- Since tg 
around to = t 

I 

where 


we shall consider, on one hand, the first order Taylor expansion of d^{u,to) 


(it, to) = d^{u,T) + 


dd^ {u,to) 


dtl 


{to -t) + o{\\to - ■ 


-1 


dd^ {u,t{e)) 

dt{e) 


i=i 


2 = 1 


^exp{f'{e)g{Xj,e)} 


1=1 


nexp{t-' {e)g{Xi,e)) 


V 


9(^.,e), 


/ 


and since tETEL —^ Or, we shall consider, on the other hand, the first order Taylor expansion of dij,{u, tETEL) 

d(j>{u,tETEL) = o{\\tETEL\\)- 


n—^C)0 

around tETEL = 0 


Then, 


,to) - d^{u, tETEL) = d^{u,T) + sL(0o,^*)(*O “ t) + o(||to - t||) + o{\\tETEL\\), (32) 


where Sj, 4 ', given by (|28)) , is such that 


dd^ {u,to) 


dto 


s^^{eo,e*). 


t0=T 


Denoting 


n 

h{t{e)) = -Vexp{t^(0)g(Xi,0)}g(X,,0), 

n / ^ 


the Taylor expansion of h{to) around to = "i" is equal to 


d 


0^ = h{T) + ( h{to)\t^^^ ) (to -x) + o(||to -T-lllr) 


where 


Ht) = -^exp{T'^ g{Xi,eo)}g{Xi,eo), 

2=1 

r! ^ 

h{^Q)\to=T = -^Qxp{t'^ g{Xi,eo)}g{Xi,eo)g'^{Xi,0o) 

ut^ Ti . 

2=1 

= EFe. [exp{T^g(X,0o)}g(i*^,^o)9'^(^,^o)] + Op(lrxr), 
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and from it the following relation is obtained 


to-x = -E;;. [exp{T^g(X,eo)}9(X,0o)g^(^,0o)] exp{x^g(X„ 0o)}9(X„ 0o) j +Op(l.) 

We obtain in virtue of the Central Limit Theorem 

n—>CO \ / 

where Mj.^{0q,0*) is (|5(I)) , since 


[exp{T'^g(X, 0o)}9(^, ^o)] = 0^, 


and 


V exp{T^g(X„ eo)}g(X„ 6^) A Ar(0,, E^^,. [exp{2x^g(X, 0o)}9(X, e^)g^{X, 0o)]), 

• ^ I r).—^oc 


On the other hand, since 


^^exp{x'^g(Xj,eo)}^ 


(«) '^) = I X! exp{'r'^g(Xj, @ 0 )} ) exp{T^g(Xi, 0o)}(/' 
vi=i 




nexp{T^g(Xi,0o)} 


it holds 


d^{u,to) —s> fj.^{eo,0*), 

n—^oo 

where fi^{6o,9*) is (1^ . Hence, from (1^ it follows 


to) - d^{u,tETEL) - 0*) | 

"" \^sl,{eo,9*)M^,ieo,e*)s^,{eo,9*) ' ™ 


which is equivalent to the enunciated result. ■ 

Theorem 4 Under the assumption that 9* ^ 9q is the true parameter value 

((t)"{^)S^{9ETEL,So' 


sl,i9o,9*)M,,ieo.e*)s„,{9o,9* 


2n 


-g^{9o,9*) ^ at(0,1), 


where 


sM9o,9*) = 


_ ( *l,S^ (^0’ ^*) 


(^0’ 


a^g,(0o,0*) = -R(e*)E;^, 


f Ef^. [exp{T^g(X,eo)}] 


gix,9*) 


exp{T^g(X,eo)} 

^ 2 ,sii(^o,e*) = [exp{T^g(X,0o)}]E^;. [exp{T^g{X,9o)}g{X,9o)g^{X,9o)] 

X Ef„ 


r T .XT n M , I^Fb- [exp{r'^g(X, 6>o)}] \ ^ , 

exp{T g{X,9o)}^ --— r o m - giX,9o) 


exp{TFg{X,9o)} 


(33) 
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(34) 


Mg^ieo,e*) 


I Sn(r) Si 2 (r,eo)\ 
\sf2(r,0o) S22(r,0o)/ 


^,2{9o,0*) = ^f„ [exp{T^g{X,9o)}g{X,e*)g^{X,9o)] , 
S22(eo,r) = Ef,. [exp{2T^g{X,9o)}g{X,9o)g^{X,9o)] . 


T, -Ip and g^{9Q,9*) as in Theorem\^ 

^ p p ^ 

Proof. Since tETEL — 0^. and to —)> x, we shall consider the first order Taylor expansion of io) 

n—^oo n—^oo 

around (tETEL,to) = (0r,x), 


n i ^ J ^ , 9 d^(tETEL,T) 

U(l,[tETEL, to) = a^tUr, T ) H-- 

d^ETEL 


tETEL+ 


ddtj,{Q ri to) 


tETEL— 


dtl 


(to - t) 


to=T 


+ 0{\\tETEL\\) + o(||io - t||), 


where 


(Or 5 — 


/ n \ “^ n 

exp{x^g(Xj, 0o)} exp{T^g(Xi, 0o)}(/) 

\i=i / i=i 


^^exp{T'^)g(Xj,0o)}^ 

i=i_ 

nexp{T^g(Xi,0o)} 


V 


/ 


dd, 


(tETEL 


, to 


dtETEL 

( 




— ( 6Xp{?gygj^g(Xj, I exp(tETEL9{^i,9ETEL)} 




i=l 


X (j) 


'^exp{tlg{Xj,9o)} 

i=i expfi^y^^g(Xj, ©btel)} 




exp{io9(^i,^o)} 


V 


exp{t^y^^g(Xj, 0£:r£:L)} 
t=i 


g{Xi, 9 etel) 


and 


(tETEL, to'^ 


dtn 


^^exp{ti(’g(Xj,0o)} ) y^exp{fi^g(Xi,eo)} 


X ip 


'^exp{t^g{Xj,9o)} 

t=l (^^P{tETEL9{^i,9ETEL)} 


exp{to9'(^i,®o)} 


V 


y^ exp{t^j,^^g(Xj, esTBi)} 
j=i 


g{X,,9o), 


with ■!/)(a;) given by (1^ . Then, 

drl)(tETEL, to) = g<p{9o, 9*) + 5^(®0, 9*)tETEL + 9*){to — x) + o(| |f btEL 11) + o(l 1^0 “ tI l)i (35) 

where 

/Ei^^. [exp{x'^g(X,0o)}] 


Ex,. ^ exp{x^g(X,0o)} 
^ g^{9*,9o) = Ep(^ [exp{x^g(X,eo)}] Ex, 


gix,9* 


(36) 


r T M , (Ex,. [exp{x^g(X,0o)}] 

exp{x Pxp{x^i,(Jt.Oo)} 


g{x,9o) 
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are such that 


d^{Or,T) —^^(00,0*), 
n—>oc 

ddtj, (tETELyto^ 


dtETEL 

ddtj) (tETELyto^ 


A s^,,{e*,eo), 

.—¥00 


tETEL—Or 


dtn 


A s^s49*,eo). 


to=T 


Denoting 


n 

h(t{e)) = -^exp{t^(0)g(Xi,0)}g(X,,0), 


the Taylor expansion of h{tQ) around tg = t is equal to 


d 


where 


dt 


Qr = h{T) + ( ^ ^(io)lto=^ ) (*0 -t) + O(||to - T||lr-) 


h{T) = -Vexp{x^g(Xj,0o)}g(i^z,0o), 

f) 1 

— H'to)\t„=-r = -^exp{T'^g{X„eo)}g{Xi,eo)g'^iX),eo) 


0 


2=1 


= EFe. [exp{T^g(X,eo)}g(X,0o)g’^A,^o)] + Op(lrxr), 

and from it the following relation is obtained 

to-T = [exp{T^g(X, eo)}g{X, 9o)g^{X, 0o)] ( exp{ Ag(X„ 9o)}g(X), 9o) 

\^i=i j 

From (EH) its follows 

tETEL = -R9„(X, 9*) + Op(n-i/2), 


■ Op(l7-). 


and then 


s{ s,{9*,9o)tETEL + 0o)(io - r) 

= ,9^)g^{X,9 etel) + ,9q) (^'^exp{T'^g{Xi,9Q)}g{Xi,9o) 

’ " \”i=i / 

1 " 

= i9*,9o)giX), 9 etel) + s^^49*,9o) exp{x^g(X„ 9o)}giX), 9o) 

77, 5 n 5 n 

2 = 1 

1 

= —y^s'^<i>{d*,9o)g{Xi,9ETEL,9o)) 


where s^^{9*,9o) is 


g{X),9*,9o) = 


9iX,,9*) 
exp{x'^g(Xj, 9o)}giXi,9Q) 
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and taking into account that 


^Ff, 


^{0*,6o)g{X, Betel, do) = s^q<t>{d* ,6o)^Fg, g{X ,Betel, do) 


= 0 , 


we obtain in virtue of the Central Limit Theorem 

\/n 

^sl,{B*,Bo)VarF,, [g{X,, B*,Bo)] s,, {B*,Bo) 

which is equivalent to the theorems result. ■ 

Let 


(d(i,(tETEL,to) — g<p{do,B*)^ -^A/’(0,1), 

\ / n—^oc 


P^,{B*) = P{T^(BETEL,do) > xlJd*), 

(3g,{B*) = PiSt(B etel, do) > xlJd*), 

be the exact power functions of T^{dETEL, do) and {Betel, do) respectively, with respect to the asymptotic 
critical value of the test, at B* ^ Bo, for a significance level a. Notice that in practice, since the exact 
distributions of T^{BETEL,do) and S^{BETEL,do) are unknown, I3^^{B*) and (3g^{B*) are also unknown. The 
following result provides an approximation for and /3g,j>{B*). 

Remark 5 From Theorem\^ we can present the approximation to the asymptotic power fij, 4 ,{B*), at B* ^ Bo, 
of the empirical cf-divergence test T^{BETEL,do) for a significance level a, as 

I3*^4B*) = 1 - $ (^f^,{B*,Bo)) - P^,{B), (37) 

where $(•) is the standard normal distribution function and 

v^,{B\Bo) = — - r ^ -H{do,d*) 

^sl,{Bo, B*)M^,{Bo, B*)s^,{Bo, B*) \ 2n 

If some alternative B* ^ Bo is the true parameter, then the probability of rejecting HH) with the rejection rule 
T(j^{d ETEL,do) > Xp a ’ for fixed significance level a, tends to one as n ^ oo. Thus, the test is consistent in 
the sense of Fraser (1957). In a similar way, an approximation to the asymptotic power function Pg,i>{B*), at 
B* ^ Bo, for the empirical ((-divergence test S)){B ETEL,do) can be obtained as 

l3;,{B*) = l-^(^Fg,JB*,Bo)), (38) 

where 

Vg,{B*,Bo) = , ^ - p^^{Bo,B*) 

^sl,{Bo, B*)M,,{Bo, B*)s,,{Bo, B*) \ 2n 

From the parametric statistical inference, P*,p{B*) and fi* 4 ,{B*) are known to be good approximations of l3rp4>{B*) 
and Pg,p{B*) respectively (see for instance, Menendez et al. (1998)). Notice that in practice, since F is unknown, 
fi(p,{d*) and I3’^4,{B*) are also unknown. However, in practice j5f^,j,{B*) and Pg 4 ,{B*) are consistently estimated, 
by replacing expectations by sample means. 
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To produce some less trivial asymptotic powers that are not all equal to 1, we can use a Pitman-type local 
analysis, as developed by Le Cam (1960), by confining attention to n^/^-neighborhoods of the true parameter 
values. A key tool to get the asymptotic distribution of the statistic T^{9ETEL,do) (or S!^{9ETEL,9oj) under 
such a contiguous hypothesis is Le Calm’s third lemma, as presented in Hajek and Sidak (1967). Instead of 
relying on these results, we present in the following theorem a proof which is easy and direct to follow. This 
proof is based on the results of Morales and Pardo (2001). Specifically, we consider the power at contiguous 
alternative hypotheses of the form 

-9^^90 + 71-^/^A, (39) 

where A is a fixed vector in such that 9n G Q C MP. 

Theorem 6 Under Condition [7] and Hi n in i39\} . the asymptotic distribution of the empirical (^-divergence 
test statistics S^{9ETEL,9if) and etel,9q) is a non-central chi-squared with p degrees of freedom and 
non-centrality parameter 

S(9o) = A'^V-\9o) A. (40) 

i.e. 

St(9ETEL,9o) (orT^(9ETEL.9o)) A xlma)). 

n—¥C)0 ^ 

where V (9o) was defined in 
Proof. We can write 

Vn{9ETEL — 9o) = \/n[9ETEL — 9n) + Vn {9n — 9q) = y/n{9ETEL — 9n) + A. 

Under Hi n, we have 

'/n{9ETEL — 9n) A/’(0, V (0o)) 

n—¥oo 

and 

\/n{9ETEL — 9 q) —^ Af{A,V{9o)). 

n—^oo 

In Theorem\^ it has been shown that 

St{9ETEL,9o) = (vi9o)-^/^V^(9 ETEL—Oq )) y{9a) ^^^\/n{9ETEL-9o)-G Op{l). 

On the other hand, we have 

V{9o)-^/^^{9etel-9o) a M{V{9o)-^/^A,Ip). 

n—foo 

ITe thus obtain 

St(9ETEL,9o) A xl{5{9o)), 

with S{9o) as in A similar procedure can he followed for the proof of T^{9 etel, 9o). ■ 
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4 Robustness of empirical 0-divergence test statistics 


In Robust Statistics, two concepts of robustness can be distinguished, robustness with respect to contamination 
and robustness with respect to model misspecification. We shall understand misspecification in the sense that 
([2]) is not verified for any 0 6 0, in particular there is misspecification for the null hypothesis in (l22ll if 


||Ef [g(X,0o)]|| >0. 


For brevity, in the sequel is denoted by E[-]. 

It is well-known (see Imbens et al. (1998)) that the estimating equation with respect to 6 for the EL and 
ET estimators are given by 

n 

'^pe(x,,di,ti(ee)^ =0, e€{EL,ET}, 

2 = 1 


with 


^ + tELW9{x,e) 

pet {x, 9, tEL{0)) = t%E{e)G^{9) exp {t%j,{e)g{x, 0)} . 


(41) 

(42) 


In relation to the ETEL estimators, from Theorem 2 of Schennach (2007) the following estimating equation 
with respect to 9 is obtained 

n 

Pet EL {xi,9ETEL,tET{9ETEL)^ =0, 

i=l 


with 


PETEL {x, 9, tET{9)) = t%T{G)Gin{9) (exp {t%E{0)g{x, e)} - exp^r(0)) , (43) 

exp£;r(6>) = {t^sTi.^)g{xj,0)] , X e {a;j}j=i- 

The influence functions for the three types of estimators, EL, ET, ETEL, are proportional to the pt {x,9,ti{9)) 
function, for i S {EL, ET, ETEL}, respectively, given in 

IT{x,9i,En.e) oc pi (x,9i,te{9i)^ , 

where tETEL{9) — tET{9)- Evaluating pel {^,9EL^tEL{9EL)^ at perturbations of tELi^EL) ^ 0,., it can be¬ 
come unbounded even if g(x, 9) is bounded, i.e. the influence function of 9el can be unbounded. This is in con¬ 
trast with the influence function of SLiid9ETEL, since pet (x, 9EL,tEL{9ET)^ and petel (^x, 9EL,tEL{9ETEL 
are affected to a much less extent by perturbations of tET{9e), ^ G {ET, ETEL}, respectively. At the limiting 
values of the estimators, 9i —> 9q, ti{9i) —^ 0^., for £ G {EL, ET, ETEL}, respectively, the influence 

n—¥oo n—yoo 

functions for the three types of estimators, are identical, 

ITix,9i,F„,g„) = V {9o) 5^2 {0o) {0o)gix,9o), 

reflecting the first order equivalence of the estimators (for a detailed proof see Lemma 1 in Balakrishnan et al. 
(2015)). 
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Let T{») be the functional associated the ETEL estimator of 9, i.e. 


T{Fn,e) = 9 etel, T{Fn^eo) = 9 q, 

and the test-statistic S^{9etel,9o), given in (PI). defined now through its functional 

StiFn,e) = {Pet (T(F„,«)) (Oo)) = (^o) . 

d' (1) (1)^ V PET,z [do) ) 

Theorem 7 The first and second order influence functions of S'^{Fn,e) are 

IF{x,StFrz,e) = ^ Si{F^.e)l^^^^^^^^IF{x , 9 etel, Fn.e), 


and 


TT Q<t> T? \ TtT/^ Q I? ■sSr^j,l/fPET,i{T{Fn,0)) 

IF2{x,S^,Fn,0) = {x,6ETEL,Fn,0) } 


d 


dT{Fn, 0 ) 


PET,z {T{Fn,0)) 


V PET,i { 9 o) J PET,i { 9 o) 
d 


+ 


2^ ^ (Pet,z{T{F^p)) 


■E 


dT^{Fn. 0 ) 

^ d 


Proof. Let 


^ V PET,i{ 9 o) ) \dT'^{Fn,0) 


Fn,e ,0 — (1 ^)Fji 0 sSxi hx(^) — 


PET,i {T{Fn,0)) IF{x,6eTEL, Fn, 0 ) 


-PET,i {T{Fn,0)) TF2{x, Betel, Fnfi). 


0, s < X, 


1, S > X. 

the e-perturbation of F „^0 at x. The first and second order influence functions of S^{Fn, 0 ) are defined as 


XF{x,StFn,0) = St{Fr.,,p) 


£ = 0 


2n ^ fpET,z {T{Fn, 0 ))\ d 


de 


PET,i {T{Fn,e,0)) 


V Pet,i{9q) 

2 n ^ I' pet,z (T(E„,e)) 

^ V PET,lido) ) \dT^{Fn,0) 


^ 1 ^_ T(F g') ^ETEL ; ^tl,0 ); 


£ = 0 


- -PET,i {T{Fnp)) ] —T{Fn,e,0) 


e=0 


de^ 
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and 


52 


TT2{x,StF^,e) = ^ 


I £=0 


2n ^.„fpETAT{Fn,e))\ ( f Pbt,. (T(K.,,e))J 


■E 


+ 


Ai^) ^ V Pet,I (Oq) 

2n ^ , /PBT.i iT{Fn,e))\ A 


PET,i (^0) 


■E' 


2n 


■^-^PET,i (T{Fn,0)) 


e=0 


1 .„ [PET,i{T{Fn,0))\ [ d r ^ 

-t [Tn,e,0) 


0"(1) ^ PBT.i (^ 0 ) V Pet, i (So) J K^e 
( d 


€—0 


PET,tiT{Fn,0))j (^ Qj^Tf^p ^^ PET,iiT{Fn,0))^ ^—T{Fn,e,0) 


\9T{Fn,0) 

2n ^ / pgr,. (T(Fn,e)) 

^ V PET,i{Oo) J ydT'^{Fn,0) 


e=0 


-PET,i iT{Fn,0)) 


\ de^ 


T{F^,e,0) 


e=0 


2n 

AA) 


IF^{x, Betel, Fn.p) ^ 


(PET,i {T(Fn,0)) 


V PET,i (Bo) J PET,i (Bo) 


d 


7 PET,i {T{Fn,0)) 


d 


+ 


dT{Fr,,0) 

2 ^ ^ ^PET,^iT{Fn,0)) 


■E 


V PET,i{Bo) ) \dT'^{Fn,0) 


dT^ 

^ d 


PET,i {T{Fn,0))^ IF{x, Betel, Fn,0) 
-PET,i {T{Fn,0)) ) FF2ix, Betel, Fn,0), 


Corollary 8 Under the null hypothesis of the test l{22\} . the first and second order influence functions of the 
test-statistic 3^9etel,Bo) are given by 

IF{x, S!jl, Fn, 0 o) = —r 3AFn,0)\„„ FF{x, Betel, Fn, 0 a) = 0, 


dB^ 

XT2{x, S^, Fn,0a) = IF^{x, BeTEL, Fn,0o) 
In particular, for large samples 




OBdB^ 


^t(.Fn,0)\„„ IF{x, Betel, Fn,0o). 


IF2ix, St Fr,,0a)=IF^ix, Betel, Fr,,0a)V-^ {Bo)FFix , Betel, Fn,0a) 

= g^ix, Bo)Sp {Bo) S,2 (Bo) V (Bo) (Bo) Sp (Bo) g{x, Bo). 


(44) 


Proof. Both equalities are obtained taking into account 

d 


dB'^ 

since (j)' (1) = 0, and 

-T. ^ ^ . 52 


StFn,0)\ 


2n(j)'(F) d pj. 

0=00 ^ (^)l0=T(i^„,eo)=eo ^ > ’ 


IF'^(x,B etel, Fn,0o)-—-^ StFn,0)\g^j.f^p^ ^^^^g^FF{x,B etel, Fn,00) 


'OBdB^ 

2n 1 


d 


= XF'^{x,Betel,F n,0a)^j^y^A'' (^) ra \ p,a 

^ A ^ PET,i (Bo) oB 


PET,i (B) 


0 = 0r 


dB 


-PET,i (B) 


XF{x, Betel, Fn,0o) 


B=0o 


^ ' i—l 


XF2{x, Betel, FnA- 


6=00 
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Since 


d 


dOde^ 




de 

=2F-Meo) + Op(l), 


i=l 

r-1 


e=0o 


PET,i {9o) —logPBT.i (^) 

aO 


0=00 


an alternative expression for the second order influence function, for large sample sizes, is (HU). ■ 

Notice that qqqqt ^n{Fn,e)\Q^Q^ is the same for any cj} function and plugging any estimator into either 
EL, ET or ETEL, TF 2 [x, Fn.Oo) remains unchanged. 

A similar results of Theorem [7] and Corollary |5] can be enuntiated for the other family of test-statistics, 

Ti{Fn,0). 

Let 9*,ETEL denote the ETEL’s pseudo-true value associated with the misspecified model, i.e. 

9*,ETEL = argminlogE [exp{t^(0) {g{X,e) - E [g(A:, 6)])}] , 
s.t. E[exp{t^(0)g(X,0)}g(X,0)] =0,. 


The ETEL’s pseudo-true value can be interpreted as the best approximation to the true value, according to the 
ETEL’s estimation method. 


dGx(e) 

de 


Condition 9 We shall assume the following regularity conditions (Schennach, 2007): 
i) There exists a neighborhood of 6 ^,^etel in which is continuous and 

integrable function of X; 

i*; E [supee0exp{t^(0)g(X,e)}] < oo s.t. E [exp {t^(0)g(X, 6)} g(A:, 6)] = 0^; 


is bounded by some 


Hi) There exists a function of X, f{X), such that ||Gx(0)|l, 


dGx(0) 

de 


are bounded by f{X) and 


E [supeee exp 0)} (X)] < oo, fc 2 = 1,2, = 0,1,2,3,4, s.t. E [exp {t^{9)g{X, 9)}g{X, 9)] 


0^. 


The ETEL estimator of O^^etel-, 9etel, associated with the misspecified model, is obtained in the same 
manner done for the true model, in fact in practice it is not possible to know when the model is misspecihed. 
By following Lemma 9 of Schennach (2007), it is convenient to study, apart from the vector of parameters of 
interest 9 and the Lagrange multipliers vector t, two additional auxiliary variables G K.’’ and r G R in a joint 
vector 

f3 = i9^,t^,K^,rf. 


According to Theorem 10 of Schennach (2007), by calculating first the asymptotic distribution of ^etel = 

{9etel^'^etel^ ^'etel^ eetel)'^, and subtracting thereafter the marginal distribution of 9etel, the procedure 

. . . 

to calculate the asymptotic distribution of 9 is simplified, under misspecification. The following auxiliary 
function 

VP(X, (3) = (<p[ {X,I3),^1 (X, (X, /3), ^4(X, /3))^, 
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with 


^,{X,I3) = exp{<^g(X, e)}G^x{0) {k + tg^{X, e)K - t) + TGl{e)t, 

^^{X, (3)={t- exp{t^g(X, 6)}) g{X, 6) + exp{t^g(X, 0)}g(X, e)g^{X, 0)k, 

V^3(X,/3) = exp{t^g(X, e)}g{X, 6), 
ip4:{X,(5) = exp{i^g(X,0)} - r, 

defines ( 3 eteli the solution of ^ = 0p+2r-+i, and the pseudo-true value 

l^*,ETEL — *,ETELt^*,ETEL^'^*,ETEL^'''*,ETEl) j 

as the solution of E [<p(X, /3)] = 0p+2r-i-i- Under ConditionlHl the asymptotic distribution of I3etel is given by 

V^ifiETEL ~ f^*,ETEL ) —^ -AA r0p+2r-+i, r ^(/3 *,ETEL )^if^*,ETEL) (r ^ i(^*,ETEL)) ) ) 

’ n—^oo \ ’ 5 \ 1 / y 


with 


‘h(/3*,_ET_EL) = E [ip{X I (^*,etel)^'^^ I^*,etel)\ 
assuming that r(/3^ etel) i® nonsingular. Based on this result, 


y/niOi 


etel — d*,ETEL 


) —^ A/'fOp,S ^2 ) 

’ n->oo V ^ V^ObtblJ 


with 

S 


^/nOs 


(^Ip 0(2r-|-l)x(2r-|-l)) ^ {f3*^ETEL )^{f^*,ETEL) ^{(^*,ETEl)) 


0 


(2r-l-l)x(2r-|-l) , 


Lemma 10 The first derivative of il2\) is given hy 
d 


de^ 


PET,r {e)=PET,^ {0) G^xMtET{e) - ^-Ef{^)e-^PETG {e)tET{e) - K{e)g{x,,e) 


where exp^y(0) was defined in i4^ > 


expET G^{e) = -Vexp{t|^(e)g(X„e)}Gj^(0), 

KiO) = {expETG'^tETg'^iO) +expETG'^{e)^ expErOg'^ 


exp^y G^tETg^{0) = -Y,^MEETi0)gix^,e)}G^^{e)tET{0)g^{x,,e), 

i=l 

_ 1 

expErgg'^iS) = -^exp{Eg{Xi,e)}g{Xi,e)g'^{Xi,e). 

(For the proof see Appendix) 


2=1 


(45) 


(46) 
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Lemma 11 The first derivative of Dif, {6)) is given by 


A 


D<f {u,Pet W) =exp£;j,(0) 


■ exp{tiT(®)9(^i. ®)}V’ 


expExi^) 


exp{tiT{e)g{Xi,e)} 


Gx^tETiO) 


- exp£;T(^)- X! exp{tiT(®)9(^i. ®)}V’ 


-K{e)-^ exp{t%j,{e)g{Xi, 0)}V' 


exp£;-r(0) 


exp{i|5.(0)g(Xi,e)} 
e5cp^y(0) 


expgjn G {9)tET{0) 


exp{tj^j.{e)g{Xi,e)} 


g{x^,e) 


and 


with 'if’{x) given by 


■^Df,{u,PET{e)) A rj,4e), 

atf n^oo 


(47) 


r ^,(0)=E 1 exp{t^j,(0)g(X,e)} {ri{e) - r2{9) - rsiO)} , 


(48) 


ri(0) =E 


exp{t^^(0)g(X,0)}V’ 


'E[exp{t^^(0)g(X,0)]} 


exp{tEj.{9)g{X,9)} 


Gli9) 


tET{9), 





r -T /e 

exp{t^Ej.{9)g{X,9) 

w 

r2(0) =E-i 

exp{i£;j,(0)g(X,0)} 

E 

exp{t„^(0)g(X,0)}?/' 


- 




Y eyL'^{t^r^[0)g(X ^6)\ 

)\ 


X E [exp{tlT{0)g{X,9)}Gl{9)\ tET{9), 
r3(0) = Ls:(0)E 


\ -T 

exp{t%j,{9)g{X,9) 

\ 1 

exp{tETWgiX,9)}'4) 

.T 



) \ 


K{9) = {e [exp{tlT{e)g{X,9}}G^{9)tlT{0)g^{X,9)] + E [exp{I^T(0)g(X, 0)}G^(0)] } 


X E-i [exp{tlT{9)g{X,9)}g{X,9)g^{X,9)] , 
tET{9) is the solution in t o/E [exp {i^g(X, 0)} g(X, 0)] =Or. 


(49) 


Let Si2(0) = ^J2^=iGxi(9) be a consistent estimator of Si2(0) given in (fT51) . It is interesting that according 
to formula (42) of Schennach (2007), 

d d 

—UkuII {u,Pet (®)) = -^^etel{.9) 

= (^)G3c.(e) - 8^2(0)^ tET{9) 

= ('^X^exp{t^g(X„0)}G5,^(0)^ -S^;(0) 


tET{9), 


which matches (071) with (p{x) = X log X — X + \. 
(For the proof see Appendix) 


21 































Lemma 12 The first derivative of [Pet W ^Pet (®o)) given by 


where 


and 


with 


■^D^{PEj,{e) ,Pej, (0o)) = bxpetW-'^cI)' ( I ) exp£;j, G^{e)tET{0) 

oft ^ \PET,i[t^o)/ 



PET,^ {0) ^ exp{t^j,{e)g{Xi,e)} exp^A^o) 
PET^iido) exp{i|y(0)g(Xi,0o)} ’ 

-^D^{Pet {(^) ,Pet i^o)) >■ 

Otf n—^oo 


qg^{e,eo) = qi{e,eo) + q 2 {d,do) - 93 ( 6 , 60 ), 


(50) 


(51) 


qi( 6 , 60 ) = E-i exp{tlr{e)9{X, 6 )} 


E 


exp{t]^T{9)g{X,0)} E 

exp{t^r(6o)9(X,6o) 

exp{t£-r(^o)9(^,6o)} E 

exp{t£.j,( 6 ) 9 (X, 6 ) 


X E [exp{4j,(6)g(X,6)}Gj(6)] tET{9), 


92 ( 6 , 60 ) = K( 6 )E 

93 ( 6 , 60 ) =E 


,( exp{iBT( 6 ) 9 (X, 6 )} E [^exp{t^7,(6o)9(X, 60 ) 


exp{t^y( 6 o)g(X, 60 )} E j^exp{t^y( 6 )g(X, 6 ) 

^ 0 )} E |^exp{t£y( 6 o)g(X, 6 o) 


exp{i£j,( 6 ) 9 (X 


exp{t^T(6o)9(X,6o)} E ^exp{tET{9)g{X,6) 
tET{9) is the solution in t 0 / 0 /E [exp {t^g(X, 6 )} g(X, 6 )] = 0 ^. 


^ g{x,e) 

Gj( 6 ) tET{e), 


The following two theorems evaluate the effect of a misspecified alternative hypothesis on the asymptotic 
distribution of the empirical ^-divergence test-statistics. 

Theorem 13 Under the assumption that the pseudo-true parameter value O^t^etel is different from 9 q 


, 1/2 


(j)" ll)T^(6ETEL,9f) 


\I'^T* i9*,ETEL) 


2n 


~ (^ 0 , 6 *,£;t£;l) —>'A/’(0,1), 


where S is given by /^, rj.^{6^^ETEL) by and 
Pt*(^0,9^,^ETEl) = E“^ exp{t'^J,[0^^EJ^E]^)g(X,0^,^ETEL)} 

—T 

X E exp{t^.j,(6*^£;T£;L)9(X,6 *^£;t£;l)}</1' 
-E"^ exp{tg7,(6o)9(X,6o)} 

exp{t^y(6o)9(X,6o)}<?i I 


E 


—T 

^^P{'tET{9*,ETEL)g{X, 0t.^ETEL)} 


exp{tET{9*,ETEL)g{X, 0 »^ETEl)} 


X E 


(E [exp{t£-r(6o)9(X,6o)} 


\ exp{t£;7,(6o)9(X,6o)} 


with tET{9) being the solution in t o/E [exp {t^g(X, 6 )} 9 (X, 6 )] = 0,.. 
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Proof. The first order Taylor expansion of {u,p^rp [9)) around 9^,^etel is 

Q 

D<j, {u,Pet (®)) = {u,Pet {d*,ETEL)) + -^ {u,pET{0))\g^s^^^^^^ {9 - d^^ETEL)+o{\\9 - 9^^etel\\) ■ 

In particular, for 0 — Betel 

(^,Pet(9etel)^ = {u,Pet {9*,etel)) + ^ {'^^Pet {9))\0=e,^ETEL (^etel—9*,etel) 

+ o( 


9 etel—9*,etel 

According to Theorem ITT] a {u,Pet (9) ) converges in probability to a fixed vector, and so 

D^{u,Pet{9etel)) = D^{u,Pet {9*,etel)) + (B^^etel) {Betel — B^^etel) + o{\\0etel — ^*,_et_el||)- 

From (H5|) it holds y/no{\\BETEL — = Op(l). Thus, the random variables 

\/n (^D^{u,Pet{Betel)) — Dtj,{u,PET {B*,etel))^ and {9*) \/n{9ETEL—B^,^ETEL) 

have the same asymptotic distribution, and since 

^ (t^{BetEL, Bo) — T^{Bt:,ETEL, Bo)^ = Vn ^£>0 (^u,Pet{Betel)'^ - {u,Pet {B*,etel 
(j)"{l)T^{B^^ETEL, Bo 




the desired result is obtained. 


2n 


= Pj,^{9o, B^^etel), 


Theorem 14 Under the assumption that the pseudo-true parameter value 9 *^etel is different from Bo 

^ (j)"{l)S^{BETEL, Bp) 


_ ^ _ 

\/^^f{B*,ETEL,Bo)'S^0ETEL^Si(^*,ETEL,Bo) 


2n 


■ — h‘S*{^0,B^:ETEL)] -^A/'(0,1), 

I n—>-oo 


where S 


'U^Oetel by qsf{B*,ETEL,Bo) by dSIp and 

exp{tET{Bo)g{i^,Bo)} 


tJ'S*{^O^B*^ETEL) = E ^ 
X E 


C-D^t^ ferlofY ( exp{4y(6/*,£;T£;L)g(A:,6>*,£;T£;L)} 

E 

exp{t%E{Bo)g{X,9o)} 

)] 

y exp{tET{Bo)g{X,9o)} E 

exp{t 

T 

ET{^*,ETEL)g{X, 9 *,ETEl)} 



Proof. It is omitted since similar steps of the proof for Theorem IT^ are needed. 


Corollary 15 Under the assumption that the pseudo-true parameter value 9 *^etel is different from Bp, the 
asymptotic distribution of the likelihood ratio test-statistics is given by 

( <f"{^) Gn {Betel ,Bo) 

2n 


/ L 

^Jr'^2{B^,ETEL)'^^g^^^jG^{B*,ETEL) 


■ - Pg^{Bo,B^^etel)\ -^A/’(0,1), 

/ n—¥oo 


where 


ro2{9^,^ETEL) = rG,2{B*^ETEL) — '>'G,'i{B *,ETEl), 


(52) 
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with 


rG,2{d*,ETEL) = K{6 ^:^eTEl)^ [g{X, 6^,^ETEL)] , 

'l'G,3{d*,ETEL) = | e “^ Qy^v{iET[(^*,ETEL)g{X,6^^ETEL)} 

XE eyip{t^rp(6^ ETEL)g{X,6^:^ETEL)}G"^{6^:^ETEL) ~ Si2 (0*,ETEl) \ tET{0*^ETEL), 


K{6^,^etel) is given by and 


MG 2 (^ 0 ) 0*,etel) — log ■ 


Ee. 


*,ETEL 


—T 

exp{tET{(^*,ETEL)g{^ ,d*,ETEL)} 


E. 


Eg 


*,ETEL 


r-rT 


exp{tETiSo)g{X, 6o)} 


- E 


Eg 


*,ETEL 


^ET{^*,ETEL)g{X,6^^ETEL) - ^o) 


(53) 


Proof. With (j){x) = x log x — x El plugged into (l29ll 




is obtained, and then according to Theorem [T21 plugging 



—T 

exp{tET{9,:^ETEL)g{X , 9^:^eTEl) 

] 

—T 

exp{tET{9^^ETEL)g{.X, 9 ^,^etel)} 

exp{t^E{(^*,ETEL)g{X ,9^^etel)} y 

E 

—T 

exp{tET{.9,:^ETEL)g{X , 9^,^etel)} 


- 1 , 


E 


E 


■0 


exp{tET{(^*,ETEL)g{X, 0 *,ETEl) 


r-rT 


G'^{9*,etel) 


exp{tET{0*,ETEL)g{X, 9 *^ETEl)} 

^exp{t'^rp(6t^ETEL)giX,9 ^^ETEl) E exp{t'^j,{9:f^ETEL)giX,9^,^ETEL)}G^{9t,^ETEL) — Si2{9*,ETEl), 


E 


E 


0 


rvT 


exp{tETi9*,ETEL)g{X, 9 ^^etel) 


exp{tET{9*,ETEL)g{X, 0*,_ET_El)} 


g{^,9*, 


ETEL) 


= -E[g{X,9,, 


etel)] , 


E 


E 


0 


exp{tET{9*,ETEL)g{X, 9 ^^etel) 


= 0 , 


exp{tET{9*^ETEL)g{X, 9 *^etel)} 
into rf{9^,^ETEL), r^{9*^ETEL), 'r‘^{.9^^ETEL) of Theorem [T3] respectively, the desired result is obtained. The 
expression of (IMl) is a particular case of gj,4>{9Q, 9 ^,^etel) with (j){x) = xloga: — cc + 1 . ■ 


Remark 16 From the previous two theorems, we can present an approximation of the power function under 
misspecification f)rp4,{9^,^ETEL), at 9 ^,^etel 9o, of the empirical (f-divergence testT^{9ETEL,9o) for a signif¬ 
icance level a, as 

P^^i9^^ETEL) = 1 — <& {vj,^{9^,^etel,9q^ ~ Pe*(^*FTEl), 


where 

Vj,4>{9^,^etel-,9q) = 


, 1/2 


4>"11)T^{9etel, 9q) 


^r^A9*,ETEL)'E^g^^^^rj,^{9^^ETEL) 


2n 


— grp4>{9o,9^,^ETEL) 1 ■ 


In a similar way, an approximation to the asymptotic power function under misspecification /3g^{9^:^ETEL), at 
9 *^etel 7 ^ 9q, for the empirical cf-divergence test Tf^{9ETEL,9o) can be obtained as 

(^*S*(^*,etel) = 1 — $ (^Eg^{9,f^ETEL,9o)^ ~ Pg*{9 ,,^etel), 
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where 


Va<t> 


(0*. 


ETEL 


eo) = 


, 1/2 


(j)”{l)S^{B etel, Bq) 


bI,{o 


*,ETEL, 


0 o)S 




.qs*{^ 


*,ETEL, 


eo) 


2n 


— h‘st{^0, B^^^etel) 


In practice, /3^4 ,{B^:^etel) and I3*^4 ,{B^,^etel) are unknown but their consistent estimators are obtained by re¬ 
placing the population mean by the sample mean. 


Remark 17 The class of (f>-divergence measures is a wide family of divergence measures but unfortunately there 
are some classical divergence measures that are not included in this family of (j)- divergence measures such as the 
Renyi’s divergence or the Sharma and Mittal’s divergence. The expression of Renyi’s divergence is given by 

1 " 

^ Renyi {PeT {^) ,Pet i^o)) — 7 Pet (^) Pet i^o) , 'If a ^0,1, (54) 

1 / i=l 

with 

D'uenyi {PeT (^) ,PeT (^o)) = 1™ DRenyi {PeT (^) ,PeT (^o)) = ^Kull {PeT (^) ,PeT i^o)) 

^ a —>^0 

and 

DRenyi {PeT (^) ,PeT (^o)) = 1™ DRenyi {PeT (^) ,PeT i^o)) = -^Kull {PeT (®o) ,PeT (^)) ■ 

This measure of divergence was introduced in Renyi (1961) for a > 0 and a ^ 1 and Liese and Vajda (1987) 
extended it for all a ^ 1,0. An interesting divergence measure related to Renyi divergence measure is the 
Bhattacharya divergence defined as the Renyi divergence for a = 1/2 divided by 4. Other interesting example 
of divergence measure that is not included in the family of ((-divergence measures is the divergence measures 
introduced by Sharma and Mittal (1997). 

In order to unify the previous divergence measures, as well as another divergence measures, Menendez et al. 
(1995, 1997) introduced the family of divergences called “{h, 0)-divergence measures” in the following way 


(Pet (^) ,Pet (^ o )) — h {D^ {Pet (^) ,Pet (^ o ))) > 

where /i is a differentiable increasing function mapping from 0, (f (0) + lim(_,oo onto [0, oo), with h{0) = 0, 
h'{0) > 0, and In Table [I] these divergence measures are presented, along with the corresponding 

expressions of h and (j). 


Divergence h (x) (f {x) 

a ^ 0,1 
a 7 ^ 0,1 

Table 1: Some specific (ft., (/)-divergence measures. 


Renyi log (a (a - 1) a; + 1) , a ^0,1 

Sharma-Mittal |[1 + a (a — 1) a;] ~ ’ b,a ^ 1 
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Based on the (/i, </))-divergence measures we can define two new families of empirical (h, </))-divergence test 
statistics, 

(Oetel^Oo^ = ((pet (Setel^ ,Pet(^o)^^^ (55) 

and 

(oETEL,do^ = (^(^0 (w,Pet (®o))) -/i (^0 • (56) 

The results obtained in this paper for the empirical (/(-divergence test statistics {Betel, do) and S^{6etel,Bo) 
can be obtained for the empirical (h, (/i)-divergence test statistics defined in (l55ll and (l56|) . 

5 Simulation study 

The aim of this simulation study is to analyze the performance of the empirical (/(-divergence test-statistics when 
the ETEL estimator of an unknown parameter is considered. In this regard, robustness under misspecification 
and efficiency are studied, based on the design of the simulation study given in Schennach (2007). Let X be an 
unknown univariate random variable, with mean 0 G K. and variance cr^ € R."'" both unknown, but it is supposed 
to be known that = 6^ + 1. The corresponding moment based vectorial estimating function is g{X, 9) =02, 
with g{X,e) = {gi{X,e),g 2 {X,e))'^, 


By modifying (1551) to 


gi{X,e)=X-9, 
g2{X,9)=X^-29^-1. 

g2{X, 9)=X^- 29^ -6, S€ (-20^ oo) - {!}, 


(57) 

(58) 

(59) 


we are considering a misspecified model, with S being a tuning parameter for the model misspecification degree. 
Since the correctly specified model has a variance equal to 0^ -|- ^ with 5 = 1, less variance than the correct one 
is specified when 5 G {—29^, 1), while a bigger variance than the correct one is specified when 5 G ( 1 , 00 ). The 
EL estimator of 9 is given by 


9el = argmin logPi.EL(6') ) , 


with 


Pi,EL{d) = 


1 + Y.h=l th,EL{d)gh{Xt,9) 


i = 1, ...,n, 


(60) 


tl,EL{0), t2,EL{0) ^ 

i=l ^ + z2h=l'^h,EL{0)gh{Xi,9) 


gr{x^,9)=0, r = l,2, 


the ET estimator of 9 by 


9et = argmin J^PetA^) log {pET,i{B)), 
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with 


Pi,ET[S) = 


exp j 


E=l'th,ET{9)gh{Xi, d)j 


Xr=i exp j 

^\ll\=Ah,ET[9)gh{Xi, 

^)] 

^ , L IL. 


(61) 


n 

tl,ET{0), t2,ET{d) S.t.'^exp^J2l^^th,ET{0)gh{Xi,d)'^ gr{Xi,6) =0, r = l 


= 1 , 2 , 


i=l 


and the ETEL of 9 estimator by 

9etel = argmin ( — X) log Pi .etbl (6*) ) , 
esR \ J 

^\t\ipi^ETEL{9) = Pi,ET{9), * = 1, ■■■, n. The test-statistics T^^{9i, 9 q) and S^^{9i, 0o), withf G {EL, ET, ETEL}, 
and 

f - 1)) > AgR-{0,-1} 

^A(a;) = \ lims^o <('s(a;) = xloga: - cc -I- 1, A = 0 , 

I hms_>_i (()s(x) = — logx -I-X — 1, A = —1 

are the so-called empirical power divergence based test-statistics of Cressie and Read (1984), valid in this new 
setting for testing 

Hq : 9 = 9o vs. Hi: 9 ^ do, with do = 0. (62) 


The expressions of the empirical power divergence based test-statistics are 


T^(d,,do)= < 


A(I^ ( E {npi^eiOo)) ^ - X inpiA9i)^ 

2z:iog(|^{|i), 

1—1 ^ ' 

( n n ^ ^ 

X Pi,e(^o) log {npi^i{9o)) - X PtA^e) log(npi,^(d^)) 

i=l i=l 


A G M - {0,-1} 


A = -l 


sAiOiAo) 




2n ( A p{AA') 
A(l-(-A) pf f (So) 


2nXp,.^(d^)log(^}^) , 

2nEp.,,(«o)log(^). 


A G K - {0,-1} 


A = 0 


A = -1 


with £ G [EL, ET, ETEL}, Pi^EL{9) given by (1501) and Pi^etelA) = Pi,ET{9) by (I5T]) . It is worth of mentioning 
that the empirical likelihood ratio test-statistic of Qin and Lawless (1994) matches the case of A = 0 when the 
EL estimator of d is applied, i.e. TA{9elAo) = G'^AelAo)- 

For the study of the performance of TA{9i,9o) and SAAe,(^o), for illustrative purposes, a subset of tuning 


parameters of the empirical power divergence based test-statistics are considered, A G { —1, —0.5, 0, |}. When 
the model is correctly specified, the population’s distribution is simulated with a standard normal distribution, 
i.e. X ^ M{9, 9“^ + 8), with d = 0 and d = 1 {A = 1). When the model is misspecified, two cases are considered, 
by simulating the population distribution either through X ^ N{9,9"^+5), with d = 0 and 5 = 0.7 (cr^ = 0.7 < 1) 
or d = 0 and 5 = 1.3 {A = 1.3 > 1). The pseudo true value of the ETEL estimator is 9,t^ETEL = do = 0 for 
8 > \, and = 0, t^^ 2 ,ETEL = so even being a misspecified model 9etel is a consistent estimator 

of the true value of d. Using R = 10, 000 replications, the following results are obtained. 
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In Figure[I]the simulated cumulative distribution functions (CDF) of 9el, 9et and Betel are shown with 
a sample size of n = 1000, for the correctly specified model {6 = 1) as well as the two misspecified models 
(i5 G {0.7,1.3}). Since the sample size is very big, the three types of estimators exhibit almost the same 
CDF. The gray color line of the figures indicates the theoretical distribution with correct specification, i.e. the 
reference line to be compared. Under misspecification, as expected according to Schennach (2007), the most 
robust estimator under misspecification is Bet (it is closer to the gray line), the least robust Bel (it is further 
from the gray line), and Betel tends to be between the two. In addition. Betel tends to be in between the 
two in efficiency with respect to the exact size of the asymptotic test for small sample sizes, no as efficient as 
Bel but more efficient than Bet- In the same way, we would like to identify a test-statistic T^^{Betel,Bq) or 
St^{BETEL,Bo) with good performance at the same in robustness under misspecification and efficiency. 

The simulations showed that in robustness under misspecification (0^, Bq) is much worse than (0^, 0o), 
with i G {EL, ET, ETEL}, for this reason the following figures are focussed only on {Be, Bq). In Figure[2]the 
simulated CDFs of T^^{Be,Bo) are plotted with the three types of estimators and a degree of misspecification 
equal to ^ = 1.3, while in Figure|3]are plotted with a degree of misspecification equal to ^ = 0.7. From them, the 
test-statistic T^^{Be,Bo) with A = — 1 seems to be the most robust test-statistic under misspecification. Figure 
Slhas been plotted to compare the performance of T^^{Be,Bo) with A = — I when different types of estimators 
are plugged, £ G [EL, ET, ETEL}. As expected, the most robust test-statistic is (0_et, 0o), the worst one 
Tn~^{BEL,Bo), and Ti~^ {Betel, Bq) is in between. From Figures [2] and [3j for the misspecified model (either 
with S = 1.3 or ^ = 0.7), the exact significance levels can be visually compared with respect to the 0.05 nominal 
level, comparing the values of the black color curves just at Xo 05 = the abscissa axis, with respect to the 

gray color curve. In this regard, the exact sizes for <5 = 1.3 are better than for 5 = 0.7: for ETEL estimators the 
exact significance levels are 0.048 (A = —I), 0.036 (A = —0.5), 0.031 (A = 0), 0.025 (A = |) when <5 = 1.3 and 
0.176 (A = —1), 0.208 (A = —0.5), 0.258 (A = 0), 0.391 (A = |) when 6 = 0.7. The hgures of the simulations 
for S^^{Be,Bo), with n = 1000, were omitted, but the exact sizes are as follows: the exact significance levels 
are 0.017 (A = -1), 0.017 (A = -0.5), 0.017 (A = 0), 0.017 ( A = |) when S = 1.3 and 0.417 (A = -1), 0.417 
(A = -0.5), 0.418 (A = 0), 0.419 (A = |) when A = 0.7. 

Figure [H] and [3 represent, only for n = 100 for illustrative purposes, the asymptotic power based on the 
power-divergence test statistics T}}^{9etel,0) and {Betel,0), !irp*{B*) and l3g4>{B*) when the nominal 
significance level is a = 0.05. There are no substantial differences for a generic small or moderate samples size. 
The test-statistics T^^ {Betel, 0) and {Betel,0), with A = — 1, exhibit the exact significance levels closest 
to the nominal significance level, 0.058 for T^^{Betel,Q) and 0.052 for {Betel, 0)- In the results obtained 
in Balakrishnan et al. (2015) S^^{9el,Bo) was found out to be much more efficient than T^^{Bel,Bo) with 
small sample sizes, for being S^^{Bel,Bo) closer to the nominal level than T^^{Bel,Bo). Such a difference is 
less pronounced for T^^{Betel,Bo) and S}1^{Betel,Bo)- The performance of T^>-{Bel,Bo) with A = —1 is then 
relatively good in efficiency with small sample sizes as well as in robustness under misspecification (with small 
and big sample sizes). 

The approximation to the asymptotic power /3j.4>{B*), at 0* ^ 0, of the power-divergence test T}{^{Betel,Q) 
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"pes of estimators, for 

3). 












for the correctly specified model, with a significance level a, is according to Remark[5]and doing some algebraic 
manipulations, {0 *) = ! — $ (6**) 0)^ , where 




A.p,(y. 

2n 




. 

/ r A(x+i)e*2 1 

2(1-.»*2) \ 

A(A+1) 

V(l-A0*2)(0*2 + 1)^ 


i log (1 + 0*^) 
^ i log (1 + 0*2) 


1 j , AgR-{0,-1} 

A = 0 
A = -l 


si,, {0 *,O)MtAS*,O)s^„{9\O) = 


exp {0*2 + 

(20*2 + 1)5 (1 _ A0*2)5 ( 0*2 + 1)^-1 


(l (A+ 2)0^ 


20*4 + 40*2 1 


6> 

' 202 + 1 


( 0*4 30*2 


- 2^ (0*^ + 30*2 + 1) 2(20-2 + 1)2 (60*® + 160*5 + 190*4 + 80*2 + 1) ^ 


y(A + 2)0 



In particular. Figure [5] shows the approximated and exact asymptotic powers of T^^(9etel,0) when A = —1, 
(0*) and /3^0_i (0*), for two sample sizes n = 100 and n = 200. The approximation is quite good for the 
values not very close to 0o = 0, 0* ^ (—0.11,0.11) when n = 100, and 0* ^ (—0.075,0.075) when n = 200. 


T test-statistic for A=-1 



9 


- approximated with n=100 

-exact with n=100 

approximated with n=200 
- exact with n=200 


Figure 5: (0*) and (0*,O) when the ETEL estimator is plugged. 
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6 Conclusion 


This paper introduces empirical ^-divergence test-statistics using exponentially tilted empirical likelihood esti¬ 
mators, as alternative to the empirical likelihood ratio test-statistic. It is shown that these test-statistics follow 
the same efficiency and robustness patterns of the corresponding estimators, empirical likelihood estimators, 
exponential tilted estimators and exponentially tilted empirical likelihood estimators. This justifies the practical 
choice of the exponentially tilted empirical likelihood estimator to be plugged into the empirical ^-divergence 
test-statistics, for being a good compromise between the efficiency of the exact size of the test for small or mod¬ 
erate sample sizes and the robustness under model misspecification. According to the results of the simulation 
study, the modified empirical likelihood ratio test 


Tn ^{GeteLjOo) = 2n E Pi,ET{do)^Og{npi^ET{Oo)) — '^Pi,ETiSETEL)^Og{npi^ET{SETEL)) 1 , 

\i=l i=l / 

exhibits, by far, the best performance. 

A possible future research could include a correction of the critical value for Tn~^{0ETEL,()o) test-statistic. 
For instance, in the line of Lee (2014), bootstrap critical values of Tn~^ {0etel,0o) could be studied to be 
compared with the Wald type test-statistic’s bootstrap critical values proposed in the aforementioned paper. 
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Appendix 


Proof of Lemma IIOL Taking into account (I12|) . 


d 

J^PET,^ 


(O) 


d 1 exp{t'^j,{ 9 )g{Xi,e)} 

do n exp^rp[0) 

1 exp{t%j,{e)g{Xi,e)} {t]^j,{9)g{X„e))e5^ET{^) - 
n e5cp|y(0) 


Pet,I ( 0 ) 


^ {tETW9iXi,e)) - exp/j,{e)^expEj,{e) 


do 


^expj;r(6>)] 


where 

^ (tir(0)g(x„0)) = G^,(0)w(e) + -^tl^{e)g{x,,e) 

= {e)tET{0) - QEr=i exp{tETie)g{X,, e)}Gl^ {0) {tET{9)g^{X„ 9) + 7 ,)) 

X eMtET{0)g{X,, 0)}g{X,, 9)g^{X,, 9)^ g(X„ 9), 

^tlrie) = - {T:=,PET,^ (9) Gl^{9) {tETi9)g'^{X,,9) + /,)) 

X {EtlPET,^ {9) g{X,, 9)g^{X„ 9)) 

= - exp{tlE{0)g{Xi, 9)}G^^ (6) {tET{9)g^{X,, 9) + I,)) 

X (^Er=i exp{iij,(e)g(X„ 0)}g(X,,0)g^{X,,0)^ 
according to (41) of Schennach (2007), and 

r\ -.71 p. 

—exp^r(6>) = -^exp{t|y(0)g(Xi,0)}— {t%j,{9)g{Xi,9)) 
i—1 

= [^^^^MtlT{0)g{x.,e)}G\^{9^ tErio) 

- (^Er=i exp{tir(0)g(X„ 9)}G^^ {9) (W(e)g^(X„ 9) + /,)) 

X QeAi exp{tir(0)g(X,, 9)}g{X„ 9)g'^{X„ 9)^ ^ exp{t%^(9)g(X„ 9)}g(Xi, 9)^ 

= exp^j. G'^(9)tET(9) - K(9)exp^j.g(9) 

= exp^-ji G {9)tET{9), (63) 


with 

1 "■ 

expExOid) = - X] exp{t%E{d)g{Xi,9)}g{Xi, 9) = 0^ 
1=1 

from (Ha. Using the previous notation 


^ {tlE{e)g{X,, 9 )) = G^. { 9 )tET{ 9 ) - K{9)g{X,, 9 ), 


(64) 
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and replacing (IMl) and (1551) in the expression of -^PET,i (0), the desired result is obtained. ■ 
Proof of Lemma nil Taking into account the expression of (1551) . 


{u, Pet (9)) = t g ^ (np,r, (0))* ^ 

By plugging ■^pET,i (&) from Theorem ITUl into the previous expression, (1571) is obtained. Since according to 
the weak law of large numbers . h{Xi) —^ E[h(X)] for any integrable function h : R?’ —> R, taking the 

approppriate functions in the role of h, the limiting value of (tt, (0)) is obtained. ■ 
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